feat: Airflow with Event-scheduling, Triggerer, Opa #320
Conversation
dervoeti
moved this from Development: Waiting for Review
to Development: In Review
in Stackable Engineering
Co-authored-by: Lukas Krug <lukas.krug@stackable.tech>
There was a problem hiding this comment.
Great demo! Worked fine for me.
Approving this already because my remarks are just nit picking.
Found one more nit:
The docs say in the last step that patches the Airflow cluster "To include this in the list of DAGs (without removing the existing ones) ...", but the patch actually removes the existing ones. Or maybe I misunderstand it.
So I'd either remove the part in brackets or add the other volume mounts to the patched Airflow resource.
Thanks! Have fixed that here: 7503715 |
adwk67
moved this from Development: In Review
to Development: Done
in Stackable Engineering
Fixes #223
Requires stackabletech/docker-images#1313
N.B. to test before merging switch these links to local ones and call the demo with
-sand-dpointing to local files:e.g.
stackablectl demo install airflow-scheduled-job -s stacks/stacks-v2.yaml -d demos/demos-v2.yaml -n airflow-demoDemo tested on Kind using LoadBalancer provided by https://github.com/kubernetes-sigs/cloud-provider-kind.